Tumor Segmentation in Intraoperative Fluorescence Images Based on Transfer Learning and Convolutional Neural Networks.

OBJECTIVE: To propose a transfer learning based method of tumor segmentation in intraoperative fluorescence images, which will assist surgeons to efficiently and accurately identify the boundary of tumors of interest. METHODS: We employed transfer learning and deep convolutional neural networks (DCNNs) for tumor segmentation. Specifically, we first pre-trained four networks on the ImageNet dataset to extract low-level features. Subsequently, we fine-tuned these networks on two fluorescence image datasets (ABFM and DTHP) separately to enhance the segmentation performance of fluorescence images. Finally, we tested the trained models on the DTHL dataset. The performance of this approach was compared and evaluated against DCNNs trained end-to-end and the traditional level-set method. RESULTS: The transfer learning-based UNet++ model achieved high segmentation accuracies of 82.17% on the ABFM dataset, 95.61% on the DTHP dataset, and 85.49% on the DTHL test set. For the DTHP dataset, the pre-trained Deeplab v3 + network performed exceptionally well, with a segmentation accuracy of 96.48%. Furthermore, all models achieved segmentation accuracies of over 90% when dealing with the DTHP dataset. CONCLUSION: To the best of our knowledge, this study explores tumor segmentation on intraoperative fluorescent images for the first time. The results show that compared to traditional methods, deep learning has significant advantages in improving segmentation performance. Transfer learning enables deep learning models to perform better on small-sample fluorescence image data compared to end-to-end training. This discovery provides strong support for surgeons to obtain more reliable and accurate image segmentation results during surgery.

Feasibility of an MR-based digital specimen for tongue cancer resection specimens: a novel approach for margin evaluation.

Objective: This study explores the feasibility of ex-vivo high-field magnetic resonance (MR) imaging to create digital a three-dimensional (3D) representations of tongue cancer specimens, referred to as the "MR-based digital specimen" (MR-DS). The aim was to create a method to assist surgeons in identifying and localizing inadequate resection margins during surgery, a critical factor in achieving locoregional control. Methods: Fresh resection specimens of nine tongue cancer patients were imaged in a 7 Tesla small-bore MR, using a high-resolution multislice and 3D T2-weighted Turbo Spin Echo. Two independent radiologists (R1 and R2) outlined the tumor and mucosa on the MR-images whereafter the outlines were configured to an MR-DS. A color map was projected on the MR-DS, mapping the inadequate margins according to R1 and R2. We compared the hematoxylin-eosin-based digital specimen (HE-DS), which is a histopathological 3D representation derived from HE stained sections, with its corresponding MR-images. In line with conventional histopathological assessment, all digital specimens were divided into five anatomical regions (anterior, posterior, craniomedial, caudolateral and deep central). Over- and underestimation 95th-percentile Hausdorff-distances were calculated between the radiologist- and histopathologist-determined tumor outlines. The MR-DS' diagnostic accuracy for inadequate margin detection (i.e. sensitivity and specificity) was determined in two ways: with conventional histopathology and HE-DS as reference. Results: Using conventional histopathology as a reference, R1 achieved 77% sensitivity and 50% specificity, while R2 achieved 65% sensitivity and 57% specificity. When referencing to the HE-DS, R1 achieved 94% sensitivity and 61% specificity, while R2 achieved 88% sensitivity and 71% specificity. Range of over- and underestimation 95HD was 0.9 mm - 11.8 mm and 0.0 mm - 5.3 mm, respectively. Conclusion: This proof of concept for volumetric assessment of resection margins using MR-DSs, demonstrates promising potential for further development. Overall, sensitivity is higher than specificity for inadequate margin detection, because of the radiologist's tendency to overestimate tumor size.

Translocator Protein 18 kDa (TSPO): A Promising Molecular Target for Image-Guided Surgery of Solid Cancers.

The translocator protein 18-kDa (TSPO) is a mitochondrial membrane protein that is previously identified as the peripheral benzodiazepine receptor (PBR). Furthermore, it plays a significant role in a diverse range of biochemical processes, including steroidogenesis, mitochondrial cholesterol transport, cell survival and death, cell proliferation, and carcinogenesis. Several investigations also reported its roles in various types of cancers, including colorectal, brain, breast, prostate, and lung cancers, as well as melanoma. According to a previous study, the expression of TSPO was upregulated in cancer cells, which corresponds to an aggressive phenotype and/or poor prognosis. Consequently, the potential for crafting diagnostic and prognostic tools with a focus on TSPO holds great potential. In this context, several radioligands designed to target this protein have been identified, and some of the candidates have advanced to clinical trials. In recent years, the use of hybrid probes with radioactive and fluorescence molecules for image-guided surgery has exhibited promising results in animal and human studies. This indicates that the approach can serve as a valuable surgical navigator during cancer surgery. The current hybrid probes are built from various molecular platforms, including small molecules, nanoparticles, and antibodies. Although several TSPO-targeted imaging probes have been developed, their development for image-guided surgery of cancers is still limited. Therefore, this review aims to highlight recent findings on the involvement of TSPO in carcinogenesis, as well as provide a new perspective on the potential application of TSPO-targeted hybrid probes for image-guided surgery.

Take a shot! Natural language control of intelligent robotic X-ray systems in surgery.

PURPOSE: The expanding capabilities of surgical systems bring with them increasing complexity in the interfaces that humans use to control them. Robotic C-arm X-ray imaging systems, for instance, often require manipulation of independent axes via joysticks, while higher-level control options hide inside device-specific menus. The complexity of these interfaces hinder "ready-to-hand" use of high-level functions. Natural language offers a flexible, familiar interface for surgeons to express their desired outcome rather than remembering the steps necessary to achieve it, enabling direct access to task-aware, patient-specific C-arm functionality. METHODS: We present an English language voice interface for controlling a robotic X-ray imaging system with task-aware functions for pelvic trauma surgery. Our fully integrated system uses a large language model (LLM) to convert natural spoken commands into machine-readable instructions, enabling low-level commands like "Tilt back a bit," to increase the angular tilt or patient-specific directions like, "Go to the obturator oblique view of the right ramus," based on automated image analysis. RESULTS: We evaluate our system with 212 prompts provided by an attending physician, in which the system performed satisfactory actions 97% of the time. To test the fully integrated system, we conduct a real-time study in which an attending physician placed orthopedic hardware along desired trajectories through an anthropomorphic phantom, interacting solely with an X-ray system via voice. CONCLUSION: Voice interfaces offer a convenient, flexible way for surgeons to manipulate C-arms based on desired outcomes rather than device-specific processes. As LLMs grow increasingly capable, so too will their applications in supporting higher-level interactions with surgical assistance systems.

A System for Mixed-Reality Holographic Overlays of Real-Time Rendered 3D-Reconstructed Imaging Using a Video Pass-through Head-Mounted Display-A Pathway to Future Navigation in Chest Wall Surgery.

Background: Three-dimensional reconstructions of state-of-the-art high-resolution imaging are progressively being used more for preprocedural assessment in thoracic surgery. It is a promising tool that aims to improve patient-specific treatment planning, for example, for minimally invasive or robotic-assisted lung resections. Increasingly available mixed-reality hardware based on video pass-through technology enables the projection of image data as a hologram onto the patient. We describe the novel method of real-time 3D surgical planning in a mixed-reality setting by presenting three representative cases utilizing volume rendering. Materials: A mixed-reality system was set up using a high-performance workstation running a video pass-through-based head-mounted display. Image data from computer tomography were imported and volume-rendered in real-time to be customized through live editing. The image-based hologram was projected onto the patient, highlighting the regions of interest. Results: Three oncological cases were selected to explore the potentials of the mixed-reality system. Two of them presented large tumor masses in the thoracic cavity, while a third case presented an unclear lesion of the chest wall. We aligned real-time rendered 3D holographic image data onto the patient allowing us to investigate the relationship between anatomical structures and their respective body position. Conclusions: The exploration of holographic overlay has proven to be promising in improving preprocedural surgical planning, particularly for complex oncological tasks in the thoracic surgical field. Further studies on outcome-related surgical planning and navigation should therefore be conducted. Ongoing technological progress of extended reality hardware and intelligent software features will most likely enhance applicability and the range of use in surgical fields within the near future.

Stereotactic Navigation-Assisted Laparoscopic Resection of Challenging Low Pelvic Tumors: A Case Series.

(1) Introduction: The laparoscopic approach to low pelvic tumors is challenging and hindered by suboptimal tumor visualization and dissection, with possible oncological failure. Stereotactic navigation provides real-time image guidance that may optimize safety, accuracy, and precision when dissecting challenging low pelvic tumors. (2) Methods: Preoperative CT images were acquired with eight skin-fixed fiducials and loaded into a navigation system. A patient tracker was mounted on the bed side. Patient-to-image paired point registration was performed, and an instrument tracker was mounted on a laparoscopic instrument and calibrated for instrument tracking. Surgical operations were performed with real-time stereotactic navigation assistance. (3) Results: Three patients underwent stereotactic navigation surgery. Fiducial registration errors were good to optimal (±1.9, ±3.4, and ±3.4 mm). Lesions were easily identified and targeted with real-time navigation. Surgeries were uneventful. Histopathology examinations identified one retro-rectal schwannoma, one lateral pelvic recurrence from rectal adenocarcinoma, and one advanced anal canal carcinoma. No navigation-related complications, readmissions, or postoperative mortalities were observed. (4) Conclusions: The application of laparoscopic stereotactic navigation surgery to complex low pelvic tumors is feasible and could impact oncological surgical quality by enabling tumor targeting and ensuring resection margins. Further wider series are needed to confirm stereotactic navigation's impact on challenging low pelvic tumors.

Improving the diagnosis and treatment of congenital heart disease through the combination of three-dimensional echocardiography and image guided surgery.

OBJECTIVE: The paper aimed to improve the accuracy limitations of traditional two-dimensional ultrasound and surgical procedures in the diagnosis and management of congenital heart disease (chd), and to improve the diagnostic and therapeutic level of chd. METHOD: This article first collected patient data through real-time imaging and body surface probes, and then diagnosed 150 patients using three-dimensional echocardiography. In order to verify the effectiveness of the combination therapy, 60 confirmed patients were divided into a control group and an experimental group. The control group received conventional two-dimensional ultrasound and surgical treatment, while the experimental group received three-dimensional ultrasound and image guided surgical treatment. RESULT: In the second diagnosis, the diagnostic accuracy of type 1, type 2, and type 3 in the control group was 84.21%, 84.02%, and 83.38%, respectively. The diagnostic accuracy rates of type 1, type 2, and type 3 in the experimental group were 92.73%, 92.82%, and 92.83%, respectively. In the control group, 2 males and 1 female experienced heart failure after surgery. However, in the experimental group, 0 males and 0 females experienced heart failure after surgery. CONCLUSION: The combination of three-dimensional echocardiography and image guided surgery can improve diagnostic accuracy and surgical treatment effectiveness, thereby reducing risks and complications, and improving surgical success rate.

Boosting Luminescence Efficiency of Near-Infrared-II Aggregation-Induced Emission Luminogens via a Mash-Up Strategy of π-Extension and Deuteration for Dual-Model Image-Guided Surgery.

The simultaneous pursuit of accelerative radiative and restricted nonradiative decay is of tremendous significance to construct high-luminescence-efficiency fluorophores in the second near-infrared wavelength window (NIR-II), which is seriously hindered by the energy gap laws. Herein, a mash-up strategy of π-extension and deuteration is proposed to efficaciously ameliorate the knotty problem. By extending the π-conjugation of the aromatic fragment and introducing an isotope effect to the aggregation-induced emission luminogen (AIEgen), an improved oscillator strength (f), coupled with suppressed deformation and high-frequency oscillation in the excited state, are successively implemented. In this case, a faster rate of radiative decay (kr) and restricted nonradiative decay (knr) are simultaneously achieved. Moreover, the preeminent emissive property of AIEgen in the molecular state could be commendably inherited by the aggregates. The corresponding NIR-II emissive AIEgen-based nanoparticles display high brightness, large Stokes shift, and superior photostability simultaneously, which can be applied for image-guided cancer and sentinel lymph node (SLN) surgery. This work thus provides a rational roadmap to improve the luminescence efficiency of NIR-II fluorophores for biomedical applications.

Deformable registration of preoperative MR and intraoperative long-length tomosynthesis images for guidance of spine surgery via image synthesis.

PURPOSE: Improved integration and use of preoperative imaging during surgery hold significant potential for enhancing treatment planning and instrument guidance through surgical navigation. Despite its prevalent use in diagnostic settings, MR imaging is rarely used for navigation in spine surgery. This study aims to leverage MR imaging for intraoperative visualization of spine anatomy, particularly in cases where CT imaging is unavailable or when minimizing radiation exposure is essential, such as in pediatric surgery. METHODS: This work presents a method for deformable 3D-2D registration of preoperative MR images with a novel intraoperative long-length tomosynthesis imaging modality (viz., Long-Film [LF]). A conditional generative adversarial network is used to translate MR images to an intermediate bone image suitable for registration, followed by a model-based 3D-2D registration algorithm to deformably map the synthesized images to LF images. The algorithm's performance was evaluated on cadaveric specimens with implanted markers and controlled deformation, and in clinical images of patients undergoing spine surgery as part of a large-scale clinical study on LF imaging. RESULTS: The proposed method yielded a median 2D projection distance error of 2.0 mm (interquartile range [IQR]: 1.1-3.3 mm) and a 3D target registration error of 1.5 mm (IQR: 0.8-2.1 mm) in cadaver studies. Notably, the multi-scale approach exhibited significantly higher accuracy compared to rigid solutions and effectively managed the challenges posed by piecewise rigid spine deformation. The robustness and consistency of the method were evaluated on clinical images, yielding no outliers on vertebrae without surgical instrumentation and 3% outliers on vertebrae with instrumentation. CONCLUSIONS: This work constitutes the first reported approach for deformable MR to LF registration based on deep image synthesis. The proposed framework provides access to the preoperative annotations and planning information during surgery and enables surgical navigation within the context of MR images and/or dual-plane LF images.

Accuracy of implant placement with computer-aided static, dynamic, and robot-assisted surgery: a systematic review and meta-analysis of clinical trials.

This systematic review explores the accuracy of computerized guided implant placement including computer-aided static, dynamic, and robot-assisted surgery. An electronic search up to February 28, 2023, was conducted using the PubMed, Embase, and Scopus databases using the search terms "surgery", "computer-assisted", "dynamic computer-assisted", "robotic surgical procedures", and "dental implants". The outcome variables were discrepancies including the implant's 3D-coronal, -apical and -angular deviations. Articles were selectively retrieved according to the inclusion and exclusion criteria, and the data were quantitatively meta-analysed to verify the study outcomes. Sixty-seven articles were finally identified and included for analysis. The accuracy comparison revealed an overall mean deviation at the entry point of 1.11 mm (95% CI: 1.02-1.19), and 1.40 mm (95% CI: 1.31-1.49) at the apex, and the angulation was 3.51˚ (95% CI: 3.27-3.75). Amongst computerized guided implant placements, the robotic system tended to show the lowest deviation (0.81 mm in coronal deviation, 0.77 mm in apical deviation, and 1.71˚ in angular deviation). No significant differences were found between the arch type and flap operation in cases of dynamic navigation. The fully-guided protocol demonstrated a significantly higher level of accuracy compared to the pilot-guided protocol, but did not show any significant difference when compared to the partially guided protocol. The use of computerized technology clinically affirms that operators can accurately place implants in three directions. Several studies agree that a fully guided protocol is the gold standard in clinical practice.

Computer-assisted navigation in oral and maxillofacial surgery: A systematic review.

Background: The term "navigation" describes a device that can pinpoint critical anatomical features, the most direct path to the target, and the optimal surgical orientation. This study aimed to conduct a comprehensive literature search on computer-assisted navigation for use in oral and maxillofacial surgery. Methods: Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, relevant studies were retrieved from five electronic databases: Medline, Web of Science, PubMed, Google Scholar, and Saudi Digital Library (SDL). The central question was, "Does the computer-assisted navigation system improve the outcome of surgical procedures in the oral and maxillofacial region?" The Cochrane Risk of Bias 2 was used to determine the various types of bias. Results: Post-traumatic midfacial reconstruction is one of the many fields that have benefited from the use of computer-assisted navigation because of its reliability. It can also be used to extricate difficult foreign entities from the operative zone. Locating critical anatomical components, communicating the surgical plan to the patient, and verifying surgical success can improve the function and appearance of patients with dentofacial abnormalities. In addition, it decreases the surgical error margin and duration. Conclusion: Computer-assisted navigation is promising in surgical practice. The accuracy of surgery can be significantly enhanced by first planning the process in a virtual environment and then performing it under close supervision in real time. In addition, the time required for preoperative planning and surgery can be reduced by creating and improving software programs.

A Safe Framework for Quantitative In Vivo Human Evaluation of Image Guidance.

Goal: We present a new framework for in vivo image guidance evaluation and provide a case study on robotic partial nephrectomy. Methods: This framework (called the "bystander protocol") involves two surgeons, one who solely performs the therapeutic process without image guidance, and another who solely periodically collects data to evaluate image guidance. This isolates the evaluation from the therapy, so that in-development image guidance systems can be tested without risk of negatively impacting the standard of care. We provide a case study applying this protocol in clinical cases during robotic partial nephrectomy surgery. Results: The bystander protocol was performed successfully in 6 patient cases. We find average lesion centroid localization error with our IGS system to be 6.5 mm in vivo compared to our prior result of 3.0 mm in phantoms. Conclusions: The bystander protocol is a safe, effective method for testing in-development image guidance systems in human subjects.

Ultrasound-guided robotic surgical procedures: a systematic review.

INTRODUCTION: Ultrasound has been nicknamed "the surgeon's stethoscope". The advantages of laparoscopic ultrasound beyond a substitute for the sense of touch are considerable, especially for robotic surgery. Being able to see through parenchyma and into vascular structures enables to avoid unnecessary dissection by providing a thorough assessment at every stage without the need for contrast media or ionising radiation. The limitations of restricted angulation and access within the abdominal cavity during laparoscopy can be overcome by robotic handling of miniaturised ultrasound probes and the use of various and specific frequencies will meet tissue- and organ-specific characteristics. The aim of this systematic review was to assess the reported applications of intraoperative ultrasound-guided robotic surgery and to outline future perspectives. METHODS: The study adhered to the PRISMA guidelines. PubMed, Google Scholar, ScienceDirect and ClinicalTrials.gov were searched up to October 2023. Manuscripts reporting data on ultrasound-guided robotic procedures were included in the qualitative analysis. RESULTS: 20 studies met the inclusion criteria. The majority (53%) were related to the field of general surgery during liver, pancreas, spleen, gallbladder/bile duct, vascular and rectal surgery. This was followed by other fields of oncological surgery (42%) including urology, lung surgery, and retroperitoneal lymphadenectomy for metastases. Among the studies, ten (53%) focused on locating tumoral lesions and defining resection margins, four (15%) were designed to test the feasibility of robotic ultrasound-guided surgery, while two (10.5%) aimed to compare robotic and laparoscopic ultrasound probes. Additionally two studies (10.5%) evaluated the robotic drop-in probe one (5%) assessed the hepatic tissue consistency and another one (5%) aimed to visualize the blood flow in the splenic artery. CONCLUSION: The advantages of robotic instrumentation, including ergonomics, dexterity, and precision of movements, are of relevance for robotic intraoperative ultrasound (RIOUS). The present systematic review demonstrates the virtue of RIOUS to support surgeons and potentially reduce minimally invasive procedure times.

Correspondence attention for facial appearance simulation.

In orthognathic surgical planning for patients with jaw deformities, it is crucial to accurately simulate the changes in facial appearance that follow the bony movement. Compared with the traditional biomechanics-based methods like the finite-element method (FEM), which are both labor-intensive and computationally inefficient, deep learning-based methods offer an efficient and robust modeling alternative. However, current methods do not account for the physical relationship between facial soft tissue and bony structure, causing them to fall short in accuracy compared to FEM. In this work, we propose an Attentive Correspondence assisted Movement Transformation network (ACMT-Net) to predict facial changes by correlating facial soft tissue changes with bony movement through a point-to-point attentive correspondence matrix. To ensure efficient training, we also introduce a contrastive loss for self-supervised pre-training of the ACMT-Net with a k-Nearest Neighbors (k-NN) based clustering. Experimental results on patients with jaw deformities show that our proposed solution can achieve significantly improved computational efficiency over the state-of-the-art FEM-based method with comparable facial change prediction accuracy.

Semi-automatic standardized analysis method to objectively evaluate near-infrared fluorescent dyes in image-guided surgery.

Significance: Near-infrared fluorescence imaging still lacks a standardized, objective method to evaluate fluorescent dye efficacy in oncological surgical applications. This results in difficulties in translation between preclinical to clinical studies with fluorescent dyes and in the reproduction of results between studies, which in turn hampers further clinical translation of novel fluorescent dyes. Aim: Our aim is to develop and evaluate a semi-automatic standardized method to objectively assess fluorescent signals in resected tissue. Approach: A standardized imaging procedure was designed and quantitative analysis methods were developed to evaluate non-targeted and tumor-targeted fluorescent dyes. The developed analysis methods included manual selection of region of interest (ROI) on white light images, automated fluorescence signal ROI selection, and automatic quantitative image analysis. The proposed analysis method was then compared with a conventional analysis method, where fluorescence signal ROIs were manually selected on fluorescence images. Dice similarity coefficients and intraclass correlation coefficients were calculated to determine the inter- and intraobserver variabilities of the ROI selections and the determined signal- and tumor-to-background ratios. Results: The proposed non-targeted fluorescent dyes analysis method showed statistically significantly improved variabilities after application on indocyanine green specimens. For specimens with the targeted dye SGM-101, the variability of the background ROI selection was statistically significantly improved by implementing the proposed method. Conclusion: Semi-automatic methods for standardized quantitative analysis of fluorescence images were successfully developed and showed promising results to further improve the reproducibility and standardization of clinical studies evaluating fluorescent dyes.

First-in-human validation of a DROP-IN ß-probe for robotic radioguided surgery: defining optimal signal-to-background discrimination algorithm.

PURPOSE: In radioguided surgery (RGS), radiopharmaceuticals are used to generate preoperative roadmaps (e.g., PET/CT) and to facilitate intraoperative tracing of tracer avid lesions. Within RGS, there is a push toward the use of receptor-targeted radiopharmaceuticals, a trend that also has to align with the surgical move toward minimal invasive robotic surgery. Building on our initial ex vivo evaluation, this study investigates the clinical translation of a DROP-IN ß probe in robotic PSMA-guided prostate cancer surgery. METHODS: A clinical-grade DROP-IN ß probe was developed to support the detection of PET radioisotopes (e.g., 68 Ga). The prototype was evaluated in 7 primary prostate cancer patients, having at least 1 lymph node metastases visible on PSMA-PET. Patients were scheduled for radical prostatectomy combined with extended pelvic lymph node dissection. At the beginning of surgery, patients were injected with 1.1 MBq/kg of [68Ga]Ga-PSMA. The ß probe was used to trace PSMA-expressing lymph nodes in vivo. To support intraoperative decision-making, a statistical software algorithm was defined and optimized on this dataset to help the surgeon discriminate between probe signals coming from tumors and healthy tissue. RESULTS: The DROP-IN ß probe helped provide the surgeon with autonomous and highly maneuverable tracer detection. A total of 66 samples (i.e., lymph node specimens) were analyzed in vivo, of which 31 (47%) were found to be malignant. After optimization of the signal cutoff algorithm, we found a probe detection rate of 78% of the PSMA-PET-positive samples, a sensitivity of 76%, and a specificity of 93%, as compared to pathologic evaluation. CONCLUSION: This study shows the first-in-human use of a DROP-IN ß probe, supporting the integration of ß radio guidance and robotic surgery. The achieved competitive sensitivity and specificity help open the world of robotic RGS to a whole new range of radiopharmaceuticals.

Current Trends and Beyond Conventional Approaches: Advancements in Breast Cancer Surgery through Three-Dimensional Imaging, Virtual Reality, Augmented Reality, and the Emerging Metaverse.

Breast cancer stands as the most prevalent cancer globally, necessitating comprehensive care. A multidisciplinary approach proves crucial for precise diagnosis and treatment, ultimately leading to effective disease management. While surgical interventions continue to evolve and remain integral for curative treatment, imaging assumes a fundamental role in breast cancer detection. Advanced imaging techniques not only facilitate improved diagnosis but also contribute significantly to the overall enhancement of breast cancer management. This review article aims to provide an overview of innovative technologies such as virtual reality, augmented reality, and three-dimensional imaging, utilized in the medical field to elevate the diagnosis and treatment of breast cancer. Additionally, the article delves into an emerging technology known as the metaverse, still under development. Through the analysis of impactful research and comparison of their findings, this study offers valuable insights into the advantages of each innovative technique. The goal is to provide physicians, surgeons, and radiologists with information on how to enhance breast cancer management.

Utilization of Augmented Reality Head-Mounted Display for the Surgical Management of Thoracolumbar Spinal Trauma.

Background and Objectives: Augmented reality head-mounted display (AR-HMD) is a novel technology that provides surgeons with a real-time CT-guided 3-dimensional recapitulation of a patient's spinal anatomy. In this case series, we explore the use of AR-HMD alongside more traditional robotic assistance in surgical spine trauma cases to determine their effect on operative costs and perioperative outcomes. Materials and Methods: We retrospectively reviewed trauma patients who underwent pedicle screw placement surgery guided by AR-HMD or robotic-assisted platforms at an academic tertiary care center between 1 January 2021 and 31 December 2022. Outcome distributions were compared using the Mann-Whitney U test. Results: The AR cohort (n = 9) had a mean age of 66 years, BMI of 29.4 kg/m2, Charlson Comorbidity Index (CCI) of 4.1, and Surgical Invasiveness Index (SII) of 8.8. In total, 77 pedicle screws were placed in this cohort. Intra-operatively, there was a mean blood loss of 378 mL, 0.78 units transfused, 398 min spent in the operating room, and a 20-day LOS. The robotic cohort (n = 13) had a mean age of 56 years, BMI of 27.1 kg/m2, CCI of 3.8, and SII of 14.2. In total, 128 pedicle screws were placed in this cohort. Intra-operatively, there was a mean blood loss of 432 mL, 0.46 units transfused units used, 331 min spent in the operating room, and a 10.4-day LOS. No significant difference was found between the two cohorts in any outcome metrics. Conclusions: Although the need to address urgent spinal conditions poses a significant challenge to the implementation of innovative technologies in spine surgery, this study represents an initial effort to show that AR-HMD can yield comparable outcomes to traditional robotic surgical techniques. Moreover, it highlights the potential for AR-HMD to be readily integrated into Level 1 trauma centers without requiring extensive modifications or adjustments.

A novel Foley catheter made of high-intensity near-infrared fluorescent silicone rubber for image-guided surgery of lower rectal cancer.

BACKGROUND: Urethral injury occurs in 1-6 % of male cases during minimally invasive surgery of lower rectal cancer. A Foley catheter emitting near-infrared (NIR) fluorescence of sufficient intensity has been expected to locate the urethra during image-guided surgery. Although it has been difficult to impart NIR fluorescent properties to biocompatible thermosetting polymers, we have recently succeeded in developing a NIR fluorescent compound for silicone rubber and a NIR fluorescent Foley catheter (HICARL). Here, we evaluated its NIR fluorescence properties and visibility performance using porcine anorectal isolation specimens. METHODS: The HICARL catheter was made of a mixture of solid silicone rubber and a NIR fluorescent compound that emits fluorescence with a wavelength of 820-880 nm, while a conventional transparent Foley catheter was made of solid silicone rubber only. As a standard for comparison of the intensity of NIR fluorescence, a transparent Foley catheter the lumen of which was filled with a mixture of indocyanine green (ICG) and human plasma was used. As a comparison to assess the visibility performance of the HICARL catheter, a transparent Foley catheter into which a commercially available NIR fluorescent polyurethane ureteral catheter (NIRC) was placed was used. RESULTS: A NIR fluorescence quantitative imaging analysis revealed that the Foley-NIRC catheter and the HICARL catheter emitted 3.42 ± 0.42 and 6.43 ± 0.07 times more fluorescence than the Foley-ICG catheter, respectively. The location of the HICARL catheter placed in the anorectum with a wall thickness of 3.8 ± 0.1 mm was clearly delineated in its entirety by NIR fluorescence, while that of the Foley-NIRC catheter was faintly or only partially visible. CONCLUSIONS: The HICARL catheter emitting NIR fluorescence of sufficient intensity is a promising and easy-to-use tool for urethral visualization during image-guided surgery of lower rectal cancer.

Are 3D Image Guidance Systems Ready for Use? A Comparative Analysis of 3D Image Guidance Implementations in Minimally Invasive Partial Nephrectomy.

Introduction: Three-dimensional image-guided surgical (3D-IGS) systems for minimally invasive partial nephrectomy (MIPN) can potentially improve the efficiency and accuracy of intraoperative anatomical localization and tumor resection. This review seeks to analyze the current state of research regarding 3D-IGS, including the evaluation of clinical outcomes, system functionality, and qualitative insights regarding 3D-IGS's impact on surgical procedures. Methods: We have systematically reviewed the clinical literature pertaining to 3D-IGS deployed for MIPN. For inclusion, studies must produce a patient-specific 3D anatomical model from two-dimensional imaging. Data extracted from the studies include clinical results, registration (alignment of the 3D model to the surgical scene) method used, limitations, and data types reported. A subset of studies was qualitatively analyzed through an inductive coding approach to identify major themes and subthemes across the studies. Results: Twenty-five studies were included in the review. Eight (32%) studies reported clinical results that point to 3D-IGS improving multiple surgical outcomes. Manual registration was the most utilized (48%). Soft tissue deformation was the most cited limitation among the included studies. Many studies reported qualitative statements regarding surgeon accuracy improvement, but quantitative surgeon accuracy data were not reported. During the qualitative analysis, six major themes emerged across the nine applicable studies. They are as follows: 3D-IGS is necessary, 3D-IGS improved surgical outcomes, researcher/surgeon confidence in 3D-IGS system, enhanced surgeon ability/accuracy, anatomical explanation for qualitative assessment, and claims without data or reference to support. Conclusions: Currently, clinical outcomes are the main source of quantitative data available to point to 3D-IGS's efficacy. However, the literature qualitatively suggests the benefit of accurate 3D-IGS for robotic partial nephrectomy.